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ABSTRACT 



A three-year experimental study was conducted at Northern High School, 
Baltimore City Public Schools, to gain evidence indicating whether the use of 
programmed instruction or the use of traditional instruction in high school 
mathematics resulted in (l) greater mastery of subject matter, (2) greater 
retention of subject matter, and (3) better grades in first-year college mathe- 
matics courses. ' In addition, an investigation was made of the possibility of 
an association between instructional format and (l) certain mathematical concepts 
and skills and (2) various personality differences. Differences between the 
mean scores of the various criterion measures, adjusted for differential effects 
of mental ability by analysis of covariance, were for the most part in favor of 
the group receiving conventional instruction. Some differences were statistically 
significant. No pattern of association emerged between personality factors and 
success with one or the other instructional formats. The authors do not feel 
that the results of this study, or other similar studies reported in the litera- 
ture, should alone dictate the choice of teaching mode. Other considerations 
should also influence such decisions ^ 
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A THREE- YEAR EXPERIMENTAL STUDY OF THE 
EFFECTIVENESS OF PROGRAMMED INSTRUCTION IN MATHEMATICS 

INTRODUCTION 

The purpose of this study was to compare the effects of programmed in- 
struction and conventional instruction on the teaching of senior high 
mathematics over a period of three years. The following parameters relating 
to the two experimental treatments were investigated during the course of 
the project: (l) mathematical achievement and retention, (2) student differ- 
ences in personality, temperament, and ability, (3) possible relationships 
between concepts and skills taught and instructional format, and (4-) relative 
success of the two treatment groups in first-year college mathematics. 

A survey of the numerous published studies on programmed instruction 
indicates that the following kinds of variables have been examined: sequencing, 
pacing, step size, learning format (program compared to text), difficulty 
level of materials, appropriateness of subject matter, transfer capability 
of traditional and conventional instruction, reduction of monotony, concurrent 
use of teacher and programmed instruction, student personality differences, 
student intellectual differences, attitudes of students toward programmed 
instruction, and contents of the comparison test. 

Most of the studies investigating instructional format, including the ones 
focusing specifically on programmed instruction in secondary mathematics, have 
been of limited duration. Moreover, the majority of these studies have indi- 
cated that no significant differences exist on achievement tests and other 
criterion measures between the experimental groups using programmed instruction 
and the control groups using conventional instruction. In view of the short 



duration of the majority of studies on programmed instruction, the present 
study was unique in that tenth grade students taking a three-year sequence in 
mathematics were followed through graduation from high school. In addition, 
first-year college mathematics grades were obtained for students in both treat- 
ment groups who remained in the senior high mathematics program for the entire 



three years. 
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PROCEDURE 

Research Questions , The aim of the project was to collect and analyze 
data which would help ansv/er the following questions: 

1. Does the use of programmed instruction or the use of traditional 
instruction result in greater mastery of subject matter as measured 
by standard mathematics tests? 

2. Does. the use of programmed instruction or the use of traditional 

% ' 

instruction result in greater retention of subject matter as measured 
by standard mathematics tests? 

3. Is there a relationship between success with one or the other 
instructional format and various student personality differences? 

4. Are certain mathematical concepts and skills taught more effectively 
by the use of one instructional format than the other? 

5. Do students using programmed instruction or traditional instruction 
in high school mathematics obtain better grades in first-year college 
mathematics courses? 

Subjects . A group of students enrolled in the college preparatory curri- 
culum at Northern High School, Baltimore City Public Schools, constituted the 
population for this study. Northern High School, which enrolled its first senior 
high school class (Grade 10) in September 1966, was chosen as the setting 
because the authors felt that the members of a newly formed mathematics depart- 
ment would participate willingly in an instructional research project requiring 
special teaching arrangements, responsibilities, and the use of new materials. 

The Baltimore City Public School System has an open enrollment policy 
on the secondary level, and therefore tenth grade, students who elected the 



college preparatory course at Northern were not .drawn primarily from any one 

t 

neighborhood but from the entire city area. A sufficient number of students 
enrolled to form fifteen classes of tenth grade geometry, these classes being 
formed as required by the process of individual student scheduling. Of these 
fifteen classes, two were designated Special College Preparatory and thirteen 
were designated College Preparatory. 

Students ‘who met the following criteria were eligible for enrollment in 
the Special College Preparatory classes: 

1. Possessed an I. Q. score of 110 or above. 

2. Scored at least 5 months above grade level in both arithmetic and 
reading on the ninth grade Stanford Advanced Achievement Tests. 

3. Had a general average of 80 or better in major subjects in the 
ninth grade. 

4. Had completed a course in elementary algebra. 

5. Had completed Level I of a modern foreign language. 

6. Were recommended by their junior high school principal. 

• * 

Students who met these criteria were eligible for enrollment in regular 
College Preparatory classes: 

1. Had to have an I. Q. test score of 90 or better. 

2. Had to have at least an 8,5 grade level achievement test score in 
both arithmetic and reading (Standard Advanced Achievement Test) 
administered in the ninth grade. 

3. Had to have a general overall average of 7C or better in all major 
subjects. 

Cf the fifteen classes enrolled in geometry, five were selected 
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5 . 



\ 



for inclusion in the experimental group. As a result, one Special College 
Preparatory and four College Preparatory classes were designated as experi- 
mental. .From the remaining ten classes, the remaining Special College Pre- 
paratory class was designated as control, and four College Preparatory classes 
out of the remaining nine of these were selected as controls. 

Before a student was admitted to an experimental class, written permission 
was obtained from parents, A letter explaining the program and requesting 
permission was sent to the parents of each experimental student. All parents 
granted permission to have their sons or daughters participate in the 
investigation. 

Class Arrangement ; The ten classes representing the two treatment groups 
were taught according to the arrangment shown in Table 1, 

TABLE ]. 

INITIAL ASSIGNMENT OF CLASSES AND TEACHERS 



Teacher 


Class 

Curriculum 


Section No. 


Class Desig- 
nated as 


I, Mrs, Floretta Fyhr 


SCP^ 


1 


E 




SCP^ 


2 


C 




cpb 


1 


C 




CP 


2 


E 


II, Miss June Danaher 


CP 


3 


C 




CP 


4 


E 


• 


CP 


5 


C 




CP 


7 


E 




CP 


10 


E 


III, Mr. L, Burton Walton 


CP 


11 


C 



. SCP means Special College Preparatory 
^CP means College Preparatory 

NOTE: Class Sections 6, 8, 9, 12, and 13 were designated neither as Control 
nor Experimental, 
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Courses and Materials . Students in the experijnental group used prograimned 
tej^tbooks throughout high school except in two instances. After careful evalua- 
tion of existing textbooks, the members of the Mathematics Department who were 
responsible for the overall instructional program in mathematics as well as the 
implementation of the three-year experimental study at Northern High School, 
concluded that there were no adequate programmed texts available for teaching 
coordinate geometry (tenth grade) or analytical geometry (twelfth grade). The 
investigators had the choice of using what were considered inferior programmed 
texts or using conventional texts, and, thereby introducing an extraneous inde- 
pendent variable into the experiment. An administrative decision, based on a 
commitment to provide what the teachers and supervisors felt was the best possi- 
ble instruction in mathematics for their students, resulted in the use of con- 
ventional text material in grade ten for a four-week period and in grade twelve 
for about a six-week period. 

During the first year, tenth grade, all experimental students conipleted the 
Temac Plane Geometry text. (All Temac Programmed Materials are published by 

Encyclopaedia Britannica Press). In addition, the students completed the Balti- 

1 

more City Public Schools Coordinate Geometry text, written in conventional format 
by William J. Gerardi, Baltimore City Public Schools. About four weeks were de- 
voted to the Coordinate Geometry text. Of the total group, five students also 
completed the Temac Second Year Algebra text. One pupil completed the Temac 
Solid Geometry text. 

In the eleventh grade, all experimental students completed the Temac Algebra 
II text and the Temac Trigonometry text. 

The programmed texts used during the senior year were Introduction to Pr o- 
bability and Groups and Fields , both written by Earl and published by McGraw 

Hill: The World of Statistics written by Johnson and Glenn and published by 

/ - ■ “ 1 

♦ I 

McGraw Hill, and Temac Solid Geometry . In addition, as noted above, a section of 
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a traditionally written text, Foundations of Advaic ed Mathematics, written by 
Kline et al and published by American Book was used to teach analytical geometry. 
About six weeks were devoted to the teaching of analytical geometry. 

The students in the control group were taught using traditional teaching 
styles, including teacher lecture, question and answer, and class or group dis- 
cussion. In addition, generous use was made of filmstrips, projectuals, tapes, 
models, and the blackboard. Textbooks were Geometry . Plane-Solid-Coordinat^ by 
Morgan et alj Modern Algebra and Trigonometiy by Dolciani et alj and Modern 
Geometry. Structure and Method by Jurgensen et al, all of which are published 
by Houghton-Mifflin. In addition, the control group used Foundations of Advanc^ 
Mathematics by Kline et al, published by American Book Company. 

Implementation of the programmed instruction was essentially the same for 
all three years of the study. Students advanced at their own rates, but a pacing 
schedule was set up so that all students would finish the course. Needed review 
of various areas was provided by the teacher on a small group basis when certain 
topics had been completed by several students. Students were familiarized with 
the terminology of modern mathematics through the use of supplemental student 

handouts , 

In the twelfth grade, the forty-two remaining students in the experimental 
group, formed a class which was subdivided into three different ability groups. 
Subjects studied during the year were solid geometry, groups and fields, proba- 
bility, statistics, analytical geometry, and college algebra. 

The two teachers worked out a team approach which enabled each group to work 
on a different subject at a given time, following a tentative time schedule. One 
day a week was set aside for discussion by each group. While one teacher worked 
with the discussion group, the other answered individual questions from members 
of the other two groups. The other two days were devoted entirely to individual 
programmed instruction with any necessary teacher assistance. Even though this 
three-group approach meant that the teachers had to be prepared to answer questions 



on three different subjects just about every day, teachers and students found 
this method to be the most satisfactory of the three years. 

The traditional teaching styles mentioned in connection with the control 
group were used with the experimental group only for review or clarification 
where required. The experimental group did not use the blackboard for student 
work or demonstration. Filmstrips, pro j actuals, and tapes were used, however, 
as a change of pace and as supplementary materials. 

Data Collection ; As may be seen in Table 2, data gathering for this study 
involved the collection of initial or baseline data, pre— test data, and post- 
test data for each student in each of the two treatment groups. Scores on the 
following measures, administered as part o'f the city-wide- testing program, 
yielded baseline data: (l) Otis Quick-Scoring Mental Ability Test, (2) Stanford 

Advanced Reading Test, (3) Kelley-Greene Reading Comprehension Test, (4) Durost- 
Center Word Mastery Test, and (5) Stanford Advanced Arithmetic Test. In addition, 
the following measures administered especially for the study, yielded additional 
baseline data: (1) Kuder Preference Record, (2) Thurstone Temperament Schedule, 
and (3) Scholastic Aptitude Test. A list of the tests and forms of each which 
were used appears in the Appendix. 

Criterion measures yielding data on achievement and retention of content 
material included: (1) Cooperative Geometry Test, (2) Cooperative Intermediate 
Algebra Test, (3) Cooperative Trigonometry Test, and (4) the Baltimore City Ad- 
vanced Mathematics Test. In addition, the following data bearing on the effects 
of the two treatments were collected: (l) final grade in each mathematics course, 

and (2) college freshman mathematics grade. 

Table 3 lists the sixty-two variables for which data were collected during 

the first two years of the project. In addition. Table 3 reports means, standard 
deviations, rlumber of casos, and the difference of means critical ratio for these 



variables, (Data on "the tiwentiy—six variables comprising tihe tihiid year and 

follow-up are reported in Table 9> P* ^-6*) 

In -tho initial phase of the study, the number of experimental students was 

177, and the number of control students was 137. Due to the process of individual 

TABLE 2 ; 

DATA COLLECTION FOR THREE-YEAR 
STUDY ON THE EFFECTIVENESS OF PROGRAMMED 
INSTRUCTION IN MATHEMATICS 



Initial Data Collection or 
Pretests 


Intervention 


Posttests 


Year I, Grade 10, 1965-66 


TEMAC 

Plane 

Geometry 

or 

Conventional 

Plane 

Geometry 


Teacher’s Final Grade in 
Geometry 

Cooperative Geometry 
(Posttest) 


Otis Quick-Scoring Test of 
Mental Ability 

Stanford Advanced Reading Test 
Kelley-Greene Reading 
Comprehension Test 
Durost-Center Vocabulary Test 
Stanford Advanced Arithmetic 
Test 

Cooperative Geometry (Pretest) 
Kuder Preference Test 
Thurstone Temperament Test 


Year II, Grade 11, 1966-67 


TEMAC 

Algebra and 
Trigonometry 
or 

Conventional 
Algebra and 
Trigonometry 


Cooperative Geometry (Retention) 
Test 

Cooperative Intermediate Algebra 
(Posttest) 

Cooperative Trigonometry (Post- 
test) 

Teacher’s Final Grade in Inter- 
mediate Algebra and Trigono- 
metrv 


Cooperative Intermediate 
Algebra (Pretest) 
Cooperative Trigonometry 
(Pretest) 


Year III. Grade 12, 1967-68 


TEMAC 

Advanced 

Mathematics 

or 

Conventional 

Advanced 

Mathematics 


Cooperative Intermediate Algebra 
(Retention) Test 
Cooperative Trigonometry 
(Retention) Test 
Baltimore City Advanced 
Mathematics (Posttest) 
Teacher’s Final Grade in 
Advanced Mathematics 

Scholastic Aptitude Test 


Baltimore City Advanced 
Mathematics (Pretest) 


Year IV, Follow-Up 




College Freshman Mathematics 
Grade, 1st Term 
College Freshman Mathematics 
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student scheduling and the tendency for fewer students to elect the more advanced 
high school mathematics courses, the number of cases systematically decreased on 
a yearly basis. Slight variations in numbers of cases within a certain year re- 
flect such circumstances as student absences and necessary student schedule changes. 

The scores for the various subtests on the Cooperative' Geometry Test, the 
Cooperative Intermediate Algebra Test, and the Cooperative Trigonometry Test indi- 
cate achievement on specific subject matter concepts and skills. A Comparison of 
the scores on these subtests was made to determine v/hether any mathematical con- 
cepts and skills were more effectively taught through either of the two ins oructional 
formats. 
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ANALYSIS OF DATA 



Years I and II 

Comparability of Treatment Groups . The classes constituting each treat- 
ment group were selected so that they would be as equivalent as possible. 

Students were preassignod to these classes according to the requirements of 
.individual student scheduling. It was necessary, therefore, to determine if 
differences existed between the two treatment groups in academic ability and 
achievement. As indicated in Table 3, which gives the difference of means 
critical ratio, the control group obtained higher scores on each of the baseline 
tests, including the Otis Quick-Scoring' Mental Ability Test, the Stanford Ad- 
vanced Reading Test, the Kelley-Greene Reading Comprehension Test, the Durost 
Vocabulary Test, the Stanford Advanced Arithmetic Test, and the Cooperative 
Geometry Pretest. On three of these, the Otis I. Q. Test, the Durost Vocabulary 
Test, and the Geometry Pretest, the differences were statistically significant 
at the .01 level. In view of these findings, it is not surprising that at the 
end of the first year the control group obtained a higher mean score, significant 
at the .01 level., on the Cooperative Geometry Posttest. Means were significantly 
higher for each of the five subtests as well as for the total score. 

Results of Analysis of Covariance Program . In order to control for possible 
subject bias resulting from initial differences in the two comparison groups, an 
analysis of covariance program was written to partial out the effects of one con- 
comitant variable, mental ability as measured by the Otis I. Q. scores. The 
results of this program, including adjusted means and covariance values, are 
given in Table 4* A comparison of these means reveals that the differences in 
favor of the control group on the two baseline measures, the Durost Vocabulary 
Test and the Cooperative Geometry Pretestj which had been found to be statistically 
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TABLE 4 

COVARIANCE VALUES AUD 14EANS ADJUSTED FOR ONE • CONCOMITANT VARIABLE FOR 
EXPERIMENTAL AND CONTROL STUDENTS FOR THE FIRST SIXTY- 
TWO VARIABLES OF THE STUDY ON THE EFFECTIVENESS OF 
PROGRAMMED INSTRUCTION IN MATHEMATICS 



Variable Number and Name 



Ad .justed Means Covariance Value (F) 

Means in Favor Means in Favor 



Year I, Grade 10. 1965-66 
! 1. Otis I. Q. 

[ 2. Stanford Advanced Reading 

j 3. Kelley-Greene Reading Comprehension 

I 4. Durost Vocabulary Test 

I 5. Stanford Advanced Arithmetic Test 

; 6. Coop. Geom, Pretest Raw Score 

Kuder Preference Test 
7. Validity 
s 8. Outdoor 

j 9. Mechanical 

I 10, Computational 

I 11. Scientific 

12, Persuasive 

13. Artistic 

14. Literary 

15. Musical 

16, Social Service 

17, Clerical 



E)cper. Control of Exper. of Control _ 



10.14 


10.69 




4.20f 


75.50 


75.10 


0.04 




78.28 


79.99 




1.10 


9.78 


10.15 




1.76 


6.47 


7.23 




1.73 


40.36 


40.05 . 


0.37 




33.08 


33.01 


0.00 




24.36 


27.30 




4.39 + 


22.96 


24.67 




2.39 


35.26 


37.34 




1.81 


37.86 


39.64 


• 


2.08 


29.84 


29.61 


0.03 


3.16 

......a 


19.91 

a 


^1-3 




50.05 


45.63 


5.83+ 


• 


49.48 


49.09 


0.06 





Thurstone Temperament Test 

18. Active 

19. Vigorous 

20. Impulsive 

21 . Dominant 

22. Stable 

23. Sociable 

24. Reflective 

25. Teacher’s Final Grade, Geometry 

26. Coop. Geom, Posttest 

27. Theorems and Definitions 

28. Non-Numerical Applications 

29 . Construction 

30 . Logic and Proof 

31 ! Numerical and Alg. Applications 



10.34 9.88 

7.95 8.37 

11.47 11.47 

9.54- 8.33 

8.10 7.65 

11.50 10.92 

7.12 7.30 

78.10 77.30 

19.48 23.28 

7.79 7.98 

5.97 6.90 

0.29 0.75 

4.46 5.40 

5.60 6.93 



Year II. Grade 11. 1966-67 

32 . Coop, Geom, Retention Test 

33. Theorems and Definitions 

34. Non-Numerical Applications 

35. Construction 

36 . Logic and Proof 

37. Numerical and Alg. Applications 



16.60 ■ 20.53 

6.67 7.64 

4.52 5.21 

0.42 0.60 

4.68 5.59 

2.97 3.96 



1.56 

0.00 

4 . 65 '" 

1.25 

1.66 

0.39 



0.77 



0.21 



11.20 

0.34 

8.67 

41.63 

6.47 

10.96 






♦ 



16.34:* 

10.02 

5 . 82 + 



.57 
6.15 
.80 




^Data not available 
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TABLE 4 (continued) 



COVARIANCE VALUES AND MEANS ADJUSTED FOR ONE CONCOMITANT VARIABLE FOR 
EXPERIMENTAL AND CONTROL STUDENTS FOR THE FIRST SIXTY- 
TWO VARIABLES OF THE STUDY ON THE EFFECTIVENESS OF 
PROGRAMMED INSTRUCTION IN MATHEMATICS 



Variable Number and Name 

38. Coop. Int. Alg. Pretest 

39. Coop. Int. Alg. Posttest 

40. Fundamental Operations/Exponents 

41. Fundamental Operations/Radioals 

42. Graphs, Functions, Relations 

43. Quadratic Equations and Theory 

44. Progressions 

45. Variations 

46 . Logarithms 

47 . Formulas 

48 . Verbal Problems 

49 . Fundamental Operations 

50 . Miscellaneous Items 

51 . Coop. Trig. Pretest 

52 . Coop. Trig. Posttest 

53. Definitions and Understandings 

54 • Logarithms and Use of Table 

55. Trigonometry Identities and Equa. 

56 . Area of Triangle 

57. Radian Measure 

58. Laws of Sines and Cosines 

59. Practical Verbal Problems 

60 . Teacher's Final Grade, Intermediate 

61 . Algebra Gain Score 

62 . Trigonometry Gain Score 



Ad US ted Means 


Covariance Value (F) 


Exner. Control 


Means in Favor 
of Exper. 


Means in Favor 
of Control 


10.90 


11.46 




0.42 


24.35 


24.46 




0.01 


3.33 


3.24 


0.40 


0.83 


2.83 


3.03 


♦ 


6.11 


7.14 




9.9I'' 


2.22 


2.08 


0.49 




• 2.09 


1.52 


15. 53"-^' 


0.65 


2.23 


2.36 




1.58 


0.73 


31 . 14 ^'^' 




2.74 


2.64 


0.54 


1.32 


2.69 


. 2.90 




1.45 


1.62 




1.30 


1.85 


1.63 


2.19 


5.64 


1.70 


2.63 


• 


8.25 


9.51 




1.79 


4.68 


4.71 




0.01 


0.72 


1.47 




28.17’'^' 


2.70 


3.05 


■ 


1.24 


0.48 . 


0.89 




12.63^''' 


0.13 


0.08 


1.20 




0.23 


0.12 


2.39 




1.77 


1.49 


1.20 


0.47 


Math. 73 . 06 


74.42 


* 


13.46 


12.96 


0.28 


0.01 


6.69 


6.79 





+ Indicates significance at .05 level. 

^ Indicates significance at .01 level. 
** Indicates significance at .001 level. 
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significant, were no longer so after adjustments were made for differences in 
I. The control group, however, retained a significantly higher mean on the 

total score of the Cooperative Geometry Posttest, which was given at the end of 
the first year. Significant differences in favor of the control group also held 
for the following subtests of this measure: Non-Numerical Applications, Construc- 

tion, Logic and Proof, and Numerical and Algebraic Applications. 

# 

« 

Further examination of Table 4 shows that during the second year of the pro- 
ject, the control group obtained a significantly higher mean on the Cooperative 
Geometry Retention Test which was administered early in the school term. On the 
Cooperative Intermediate Algebra Posttest, given in the middle of the year, sig- 
nificant differences in favor of the control group were found on the Graphs, 
Functions, Relations subtest. Significant differences in favor of the experimental 
group were found on the Progressions and Logarithms’ subtests. No sipif leant 
difference was found between the comparison groups on the basis of the total 
scores on this test. Again, on the Cooperative Trigonometry Posttest, given at 
the end of the second year, significant differences in favor of the control gioup 
were found on the Logarithms and Use of Table and Area .of Triangle subtests, 
although no significant difference was found between the comparison groups on 
the total scores far this test. 

In Only two instances were adjusted means on the criterion measures administered 
• during the first and second years of the project found to be in favor of the ex- 
perimental group. Significant differences were obtained for the experimental 
group on the Progressions and Logarithms subtests of the Cooperative Intermediate 
Algebra Posttest. On several measures, moreover, small apparent differences did 
not turn out to be statistically significant. At the end of the first year, there 
was no significant difference between the comparison groups on the basis of the 
teacher's final grades in Geometry. During the second year, no ..statistically 

'^Due to the fact that the n's for the analysis of covariance program differed^ 
slightly from the n's used in the computation of the difference of means critical 
ratio, an apparent difference on the Stanford Advanced Reading Test, in favor of 
the control group became a statistically significant difference. 
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significant difference was found between the groups on the total Cooperative Inter- 
mediate Algebra Posttest score. Similarly, no statistically significant difference 
was found on the total Cooperative Trigonometry Posttest score, even though a sig- 
nificant difference was obtained in favor of the control group on the Trigonometry 
Pretest. No statistically significant differences were found, moreover, between 
the Teachers ' Final Grades in Intermediate Mathematics or between the Algebra 

Gain Scores or the Trigonometry Gain Scores. 

Summary nf Pretest. Posttest, and Retention Test Differences on Adjusted 
Means. A summary of pretest, posttest, retention test, and mean difference 
comparisons on the Cooperative Geometry, Cooperative Intermediate Algebra, and 
Cooperative Trigonometry tests is provided in Tables 5, 6, and 7. Significant 
differences were found in favor of the control group on the Geometry Posttest 
and Retention Test, as well as the Intermediate Algebra Retention Test. Apparent, 
but not significant, differences were obtained in favor of the control group 
on the Intermediate Algebra Posttest, the Trigonometry Posttest, and the Trigo- 
nometry Retention Test. These results should be interpreted with the knowledge 
that the' number of cases for the variables studied changed over time and also with 
the appreciation that the groups were comparable but not totally equivalent with 
respect to ability and achievement. 

Comparison of Characteristics of High Achieving and Low A chieving Experimental 
Students . In order to investigate the possible existence of differences of 
intellect, temperament, and disposition between high and low achieving students 
using programmed instruction in mathematics, scores obtained by experimental 
students on the Cooperative Geometry Posttest were arranged by computer from 
highest to lowest. Next, the scores for the 25th and 75th percentiles were computed. 
A score below 7 on the Geometry Posttest caused a student to be placed in the lowest 
quartile, whereas a score of 26 or better caused a student to be placed in the 
highest quartile grouping. There were 37 students placed in the highest quartile 



TABLE 5 



19. 



\ COOPERATIVE GEOMETRY TEST: PRETEST, POSTTEST, AND 

RETENTION TEST DIFFERENCES ON ADJUSTED MEANS 





Mei= 


NS 


>-5ci= 




6.47 


0.76 


7.23 




De= 


DC“De= 


Dc= 




13.01 


I 

I 

I 

I 

VjJ 

1 • 

0 

1 

I 

I 

I 

1 


16.05 




Me2= 


D2= 


^C2= 




19.48 


3.80^'- 


23.28 



%3“ ^3= ^C3~ 

16.60 3.93^^ 20.53 



TABLE 6 

COOPERATIVE INTERMEDIATE ALGEBRA TEST: PRETEST, POSTTEST, 
AND RETENTION TEST DIFFERENCES ON ADJUSTED MEANS 



^El- 

10 . 90 


I 

I 

I 

0 

I • a 
I 1! 

i CO 
I 

I 

1 


Mci= 

11.46 




■ ■’e= 
13.46 


Dr,- D^ = 

0.50^3 


"c= 

12.96 




Me2= 

24.35 


D2= 

NS 

0.11 


■ Mq2= 

24.46 




M = 
^E3 

23.37 


■ 

II 

0 

Q 

00 


M = 
"C3 

31.38 




E=experimental group 
C=control group 
M^^pretest 




M2=posttest 

Mo=retention 

D&ifference 


test 
or gain 



^ designates significance at .001 level. • 

NS designates no significance. 

NOTE: Pretest and posttest means as well as mean differences have been 
computed on available data, and accordingly, the- n's vary slightly. 
Retention test n's vary to a greater extent. The n's for all variables 
are given in Tablb 3, p. U and Table 9 , p. 26. 



MC 



iiiiiiiiM 













I 

3.31 

I , - - ■ - 



V 

1.22 



NS 



Mc3= 

4.53 



Kex: 



E=oxperimental group 
C=control group 
M-^=pretest 



M2=posttest 
M^=retention test 
D=difference or gain 



+ designates significance at ,05 level. 

NS designates no significance. 

NOTE; Pretest and posttest means as well as mean differences have been 
computed on available data, and, accordingly, the n’s vary slightly. The 
n’s for all variables are given in Table 3, p.ll and Table 9., p. 26^. 
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and 39 studants placad in t.h6 lowast. 'quartiiD.©, High scoring and low scoring 
geometry students were compared with respect to the 33 variables studied. The 
results of this comparison are given in Table 8, 

As expected, those students in the highest quartile scored significantly 
better on the Otis Quick-Scoring Test of Mental Ability, the Stanford Advanced 
Reading Test, the Kelley-Greene Reading Comprehension Test, the Durost-Center 
Vocabulary Test, the Stanford Advanced Arithmetic Test, and the Cooperative 
Geometry Pretest. Differences were significant beyond the .01 level of confidence. 

On four of the five subtests of the Cooperative Geometry Posttest, signifi- 
cant differences were obtained in favor of the experimental students comprising the 
highest quartile. On the fifth subtest, however. Construction, no significant 
difference was found between the top scoring and low scoring groups. 

It had been anticipated that differences in personality and disposition 
might exist between high and low scoring students as measured by the Kuder Pre- 
ference Test and the Thurstone Temperament Test. This was nut the case. No 
significant differences emerged between these two groups on any of the areas 
surveyed by the Kuder Preference Test: Outdoor, Mechanical, Computational, Sci- 
entific, Persuasive, Artistic, Literary, Musical, Social Service, and Clerical. 
Likewise, no significant differences emerged between the two groups on any of 
the areas surveyed by the Thurstone Temperament Test, including the following 
categories: Active, Vigorous, Impulsive, Dominant, Stable, Sociable, and Reflective. 

Comparison of Experimental and Control Groups Psychological Test Variables . 

In an attempt to investigate the possiblity of an association between various 
learner characteristics as measured by the Kuder Preference Test or the Thurstone 
Temperament Test and success with either of the two instructional formats used 
in the project, differences in scores on these instruments were compared by means of 



a critical ratio. As shown in Table 3, P*31> the only significant differences 
between the two groups on the Kuder Preference Test were a social service prefer- 
ence in the. experimental group and a literary preference in the control group. 
Table A15 (Appendix, p. A 1) indicates that although a significant negative cor- 
relation appeared between the experimental group social service preference and 
the experimental group Cooperative Trigonometry Pretest, no meaningful pattern 
was established between this particular trait, or any other, and the mathematics 
achievement tests. As regards the control group. Table Al6 (Appendix, p. A 6) 
indicates that no pattern of significant correlation was eSwablished between 
literary preference and the mathematics achievement tests. 

On the basis of the Thurstone Temperament Test scores, the only significant 
difference in personality between the two treatment groups was in the area of 
dominance, in the direction of the experimental group. No significant correla- 
tion or pattern of association was established between this particular trait, 
or any other trait measured by the test, and the mathematics achievement tests 
administered during the project. 

Relationships Between Experimental Variables . Pearson product-moment corre- 
lation coefficients were computed for all sixty-two variables of the first two 
years of the project. These correlation coefficients for the experimental and 
control groups are reported in Tables A15 and Al6 (Appendix, pp. A1 -A9.) In 
both treatment groups, as would be expected, a pattern of positive correlation 
was established between I. Q. scores and mean mathematics achievement test scores 
particularly those obtained on the posttests. Generally, somewhat lower corre- 
lations appeared between mean I. Q. scores and teachers’ final grades in Geometry 
and Intermediate Mathematics. 

In both of thP treatment groups a pattern of positive correlation was estab- 
lished between the mean scores of the various standardized tests given to measure 



25 . 



mastery of subject matter. Correlation coefficients were again higher for posttest 
comparisons. Moreover, a fairly consistent relationship was established between 
mean scores on the standardized posttests and teachers’ final grades. 

Year III . 

Size and Comparability of Treatment Groups at the Beginning of Year I II. 

During the final phase of the project, data were collected for thirty-six 
additional variables for those students who remained in the experimental mathe- 
matics program at Northern High School for the third year. Forty— two students 
of the original experimental group studied Advanced Mathematics using programmed 
instruction. Thirty-six students of the original control group studied Advanced 
Mathematics using conventional instruction. 

The mean I. Q. score for the remaining experimental students was 115. 43 J 
the standard deviation was 8,54. The mean I. Q. score for the remaining control 
students was 119.50; the standard deviation was 5.42. The difference between 
the means of the two groups was significant at the .05 level. 

The variable names and numbers as well as means and standard deviations 
for both treatment groups for Year III are reported in Table 9. As indicated 
in this table, the experimental group obtained a higher unadjusted total mean 
score on the Baltimore City Advanced Math Pretest. On the Baltimore City 
Advanced Math Posttest, however, results were in favor of the control group. 

In addition, there was an apparent difference in favor of the control group 
in the amount of progress made in twelfth grade mathematics, as revealed by 
the Advanced Math Gain Score and the Teacher’s Final Grade in Advanced Math. 

Results of Analysis of Covariance Program . In order to control for subject 
bias resulting from the effects of differences in mental ability, the analysis 
of covariance program used to analyze the data for Years I and II, was again run 
for selected variables of Year III. The results of this program, including 
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adjusted means and covariance values, are given in Table 10. The findings with 
regard to the Cooperative Intermediate Algebra Retention Test and the Cooperative 
Trigonometry Retention Test have already been discussed above under Analysis o f 

— years I and II , p. With regard to the criterion measures relevant to 

mastery of subject matter taught during Year III, the following observations, 
summarized in Table 11, may be made. On the basis of adjusted means there was 
no statistically significant difference between the treatment groups on the Baltimore 
City Advanced Mathematics Pretest. The differences between the two groups on the 
Advanced Mathematics Posttest and the Mathematics Gain Score, however, were 

determined to be statistically significant ones in favor of the group receiving 
conventional instruction. 

Relatio nships Between Variables Within the Experimental Group . Pearson 
product-moment correlations were computed for the twenty-six variables of the 
final phase of the study. These correlation coefficients for the experimental 
and control groups are reported in Tables Al? and A18 (Appendix, pp. AlO-A 17). 

In the experimental group, significant positive correlations- appeared between 
the baseline I. Q. measure and the tests used to evaluate retention of subject 
matter, the Cooperative Intermediate Algebra Test and the Cooperative Trigonometry 
Test. I. Q. was also significantly correlated with the teachers’ final grades 
,in Advanced Math and the Scholastic Aptitude Test scores. I. Q. scores were not 
significantly correlated with the Baltimore City Advanced Math Pretest or Posttest 

scores, but they were significantly correlated with the Baltimore City Advanced 
Math Gain scores. 

In a number of ipstarces there were significant positive relationships between both 
Retention Tests, Intermediate Algebra and Trigonometry, and the standardized 
tests of mathematics given during Years I and II of. the study. Furthermore, 
the Intermediate Algebra Retention Test, but not the Trigonometry Retention Test, 
however, correlated significantly with the Scholastic Aptitude Test. There was 
no s.ignif leant pattern of association established between the Baltimore City 
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TABLE 10 



\ 



COVARIANCE VALUES AND MEANS ADJUSTED FOR ONE CONCOMITANT VARIABLE 
FOR CONTROL AND EXPERIMENTAL STUDENTS FOR TEN SELECTED 
VARIABLES OF YEAR III OF THE STUDY ON THE EFFECTIVE- 
NESS OF PROGRAMMED INSTRUCTION IN MATHEMATICS 



Variable Number and Name 



Adjusted Means Covariance Value fF) 



Means in Favor 
Exper. Control of Exper, 



Means in Favor 
of Control 



Year 



63. 

76. 

86 . 

87. 

93. 

94. 

95. 

96. 

97. 

98. 



Ill, Grade 12. 1967-68 
Coop. Int. Alg. Ret.TestjFm.ZjRaw Sc. 
Coop. Trig. Ret. Test, Fm.Y, Raw Score 
Balto.City Adv. Math Pretest, Raw Sc. 
Balto.City Adv. Math Posttest, Raw Sc 
Balto.City Adv. Math Gain Score 
Teacher's Final Grade, Adv. Math. 
Scholastic Aptitude Test Score 
College Math Grade, 1st Term 
College Math Grade, 2nd Term 
Math Power Score 



23.37 


31.38 


20.82^^^ 


3.31 


4.53 


2.84 


6.51 


6.78 


0.13 


. 8.83 


11.64 


14.19^^^^ 


2.79 


5.09 


8.76^ 


80.88 


83.40 ' 


1.67 


523. 50 


564. 83 


5.35'- 


2.66 


2.91 


0.84 


2.77 


2.65 


0.15 


7.06 


10.89 


4.3> 



+ Indicates significance at .05 level. 
^Indicates significance at .01 level. 
^^Indicates significance at .001 level. 



Advanced Mathematics Pretest or Posttest scores and the scores on the baseline 
measures or- the criterion measures. 

A pattern of significant correlation was established between the 
Scholastic Aptitude Test and the majority of standardized tests used as baseline 
measures or criterion measures. 

^ No meaningful pattern of association was established between the subtests 
of the Kuder Preference Test or the Thurstone Temperament Test and the variables 
related to mastery of subject matter. Thus, no meaningful patterns of association 
were found to exist in the experimental group between various vocational prefer- 
ences or qualities of disposition and variables measuring mastery of subject matter, 

I^.Q^ Q-'^io^^ships Between Variables Within the Control Group . Table AL8 (Appendix, 
p. A14) indicates that, contrary to the results obtained for the experimental 
group, no significant correlations appeared in the control group between the 
baseline I. Q, measure and any of the standardized tests administered during 
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TABLE 11 



BALTIMORE CITY ADVANCED MATHEMATICS TEST: PRETEST AND 
POSTTEST DIFFERENCES ON ADJUSTED MEANS 



«E1= 

6.51 


^ ir,NS 
0,27 


Hci= 

6.78 




^C”^E~ 


II 

o 

Q 


2,79 


1 

1 

1 

1 

1 

1 

O 1 

• 1 

cv 

1 

1 

1 

1 

1 


5.09 


«E2= 


»2= 


Mc2= 


8.83 


2,81^^^^ 


11.64 



Ke^: 



E=experimental group M 2 =posttest 

C=control group D=difference or gain 

M2^=pretest 

NS designates no significance, 

^ designates significance at ,01 level, 
designates significance at ,001 level, 

NOTE: Pretest and posttest means as well as mean differences have 
been computed on available data, and, accordingly, the n's vary 
slightly. 



Year III of the project. In other words, a relationship which had obtained for 
both treatment groups for Years I and II of the project and for Year III for 
• the experimental group, did not hold for Year III for the control group. Exami- 
nation of the mean I, Q, scores and standard deviations recorded for those 
students remaining in the program, as reported above on p, 25, indicates that 
the control students had a significantly higher , mean I, Q, and a lower standard 
deviation, A manual check on the data revealed that when scores on two variables 
for example, I, Q, scores and Scholastic Aptitude Test scores, were both con- 
sistently high, opportunities for correlation between scores were reduced. At 
the upper end of the scale, certain of these measuring instruments are apparently 



limited in ability to discriminate with the precision needed to develop significant 
correlations. 

With regard to the Retention Tests, significant positive correlations appeared 
between the Intermediate Algebra Test, but not between the Trigonometry Test, however 
and the standardized tests of mathematics given during Years I and II of the study. 
Both of these Retention Tests correlated significantly with the Scholastic Aptitude 
Test. 

There was no pattern of significant correlation established between the 
Baltimore City Advanced Mathematics Pretest or Posttest dnd the baseline measures, 
including I. Q. There was a pattern established, however, between the Baltimore 
City Advanced Mathematics Posttest and the majority of criterion measures for all 
three years! 

No meaningful pattern of association was established between the subtests 
of the Kuder Preference Test or the Thurstone Temperament Test and the variables 
related to mastery of subject matter. 

I 

College Follow-Up 

Choice of College . At the close of the academic year I968-69, a questionnaire 
was mailed to each graduate of Northern High School who participated >in all three 
years of the study. (See Appendix, p.A22 for a sample questionnaire). Students 
who did not reply to the initial request for information on college mathematics 
courses and grades were asked a second time to supply. this information. Of the 
forty- two experimental students, thirty-eight (90^) responded the first semester, 
and thirty-four (81^) responded the second semester J Of the thirty-six control 
students, thirty-five (97^) responded the first semester, and thirty-one (86^) 
responded the second semester. Rate of response, therefore, was a little higher 
both semesters for the control students . 

As shown in Table 12, thirty-five experimental students, or 88^ of those 



TABLE 12 



SUMMARY OF COLLEGES ATTENDED BY 
EXPERIMENTAL AND CONTROL STUDENTS 



College 


No . of Experimental 
Students Attending 


No. of Control 
Students Attending 


Bennington College (Yt.) 


« 


1 


» 

Brown University (R. I.) 




1 


College of Notre Dame of Maryland (Md. ) 




1 


Community College of Baltimore (Md.) 


5 


4 


Elizabethtown College (Pa.) 




1 


Frostburg State College (Md.) 


3 


1 


« 

Georgia Institute of Technology (Ga.) 




1 


Goucher College (Md.) 


1 




Indiana University (Ind. ) 




1 


Loyo.la College (Md. ) 


1 




Mt. St. Agnes College (Md.) 


2 




Muhlenbur^ College (Pa.) 


1 




St. John's, Annapolis (Md.) 


1 


• 


St. Mary's College of Maryland (Md.) 


1 




Towson State College (Md. ) 


12 


•9 


Trinity College (Conn.) 




1 


Union Memorial Hospital School of Nursing (Md.) 1 




University of Maryland (Md. ) 


4 


7 


University of Pennsylvania (Pa.) 




1 


Villa Julie (Md.) 


1 


*- 


Western Maryland College (Md.) 


2 


3 


Treatment Group Comparisons 


Experimental 


Control 




Students 


Students 


No. of Students Responding Either Semester 40 


35 


No. of Students Attending College 


35 


32 


No. of Different Colleges 


13 


13 


No. of Out-of-State Colleges 


1 


7 



33 



who responded either semester, reported attendance at thirteen different 
colleges. Of these thirteen institutions, twelve were located within the 
state of Maryland; one was located outside the state. Thirty- two control 
students, or 91^ of those who responded either semester, reported attendance 
at thirteen different colleges. Of these thirteen institutions, six were 
located within the state of Maryland; seven were located outside the state. 

In summary, a slightly higher percentage of control students reported college 
attendance. Moreover, more control students attended colleges out of the 
state of Maryland than did experimental students. 

Courses Taken and Grades Earned . Tables 13 and 14 report the semester 
courses taken and grades earned by the students in the two treatment groups. 
These courses were arbitrarily categorized as Elementary Level Courses, 
Statistics Courses, or Intermediate and Advanced Level Courses. Each of 
these three categories was assigned a difficulty rating. Grades earned in 
each course were given numerical point values and these values were multiplied 
■ by the course difficulty rating. 

As reported in Table 10, p. 29, the control group obtained a significantly 
higher mean mathematics power score. On the basis of this variable and from 
inspection of the data reported in Tables 13 and 14, it appears that the 
thirty— two control students who attended college took somewhat more difficult 
college mathematics courses and earned somewhat higher grades than the thirty- 
five experimental students attending college. 









TABLE 13 



SUMMARY OF COURSES TAKEN AND GRADES 
EARNED BY EXPERIMENTAL STUDENTS 




TABLE 14 



SUMMARY OP COURSES TAKEN AND GRADES 
EARNED BY CONTROL STUDENTS 





No. 


of Semester 


Grades 


Elementary Level Courses (Difficulty Rating=l 




Courses 


A 


B 


C 


D 


• 

Basic Concepts of Arithmetic 




1 




1 






Elements of Mathematics 




5 


( 


2 


3 




Fundamentals of Mathematics 




2 


2 








General Mathematics 




1 




1 






Introduction to Mathematics 




2 






2 






Total 


11 










Courses in Statistics (Difficulty Rating=2l 


- 












Modern Elementary Statistics 




1 


i 








Modern Elementary Statistics and Probability 




1 




1 






Probability Functions 




1 






1 




Statistics 




1 






1 






Total 


4 










Intermediate and Advanced Level Courses 

1 ; . . (Difficulty Rating=3) 














Algebra and Trigonometry 




4 


1 


1 


2 




Analytic Geometry 




3 




1 


2 




Calculus I 




2 






2 




Calculus II 




2 






1 


1 


Calculus and Analytic Geometry 




4 


2 




2 




Differential Calculus 




1 


1 








Elementary Functions 




1 




1 






Integral Calculus 




2 


1 


1 






Introductory Analysis 




2 


2 








Modern Mathematics 




1 




1 








Total 


22 











NOTE: Course titles are those supplied by students. The control group was 
, credited with an additional unnamed course for which a grade of "C" was given. 






V 

« 

DISCUSSION AND CONCLUSIONS 



Mastery of Subject Matter 

Does the use of programmed instruction or conventional instruction in high 
school mathematics result in greater mastery of subject matter as me asured by 
standard mathematics tests ? At the end of the first year of the study the group 
receiving conventional instruction obtained a significantly higher mean (adjusted 
by analysis of covariance to control for differential effects of mental ability) 
on the Cooperative Geometry Posttest as reported in Table 5, p. 19. The diff- 
erence between the mean gain scores computed on the basis of Cooperative Geometry 
Pretest and Posttest comparisons was a significant one in favor of the control 
group. 

During the second year the control group obtained higher adj’usted means on 

the Cooperative Intermediate Algebra Posttest and the Cooperative Trigonometry 

Posttest, as reported in Table 6, p. 19 and Table 7, p. 20. The differences 

between the means for the two groups, however, were not statistically significant. 

The experimental group obtained a slightly higher adj’usted mean gain score on the 

basis of Cooperative Intermediate Algebra Pretest and Posttest comparisons, but 

the difference between the groups was not statistically significant. The control 

> 

group obtained a slightly higher adjusted mean gain score on the basis of Coop- 
erative Trigonometry Pretest and Posttest comparisons, but again the difference 

s 

between the two groups was not statistically significant. 

At the end of the third year, as indicated in Table 11, p. 30, the control 
group obtained a statistically significant higher adjusted mean score on the 
Baltimore City Advanced Mathematics Posttest. The control group also obtained 
a statistically significant higher mean gain score on the basis of Baltimore City 
Advanced Mathematics Pretest and Posttest comparisons. 

While the empirical evidence for the first year and the third year seems to 

lend support to the hypothesis that conventional instruction is more effective 







than programmed instruction, a visual examination of the mean standardized test 
scores, as well as the teachers’ final grades, as reported in Table 4> P? 15 and 
Table 10, p. 29, reveals that most of the obtained differences were small ones. 
Such small differences, even when statistically significant, may not be critical 
ones from a practical or operational standpoint. On the assumption that for all 
practical purposes programmed instruction proved as effective as conventional 
instruction, other considerations should influence the choice of teaching method. 

Does the use of programmed instruction or the use of traditional instruction 
result in greater retention of subject matter as measured by standardized tests? 

On the tests measuring retention of subject matter, all differences were in favor 
of the control group, as reported in Tables 5 and 6, p. 19 J Table 7, p. 20 J and 
Table 11, p. 30. Differences were statistically significant on the Cooperative 
Geometry Retention Test and on the Cooperative Intermediate Algebra Retention 
Testi but not on the Cooperative Trigonometry Retention Test, Again, it may be 
relevant to ask df these differences are important and practical ones in a real 
teaching situation. 

It is possible that uncontrolled variables operated to prevent greater 

differences from developing between the two instructional groups on the criteria 

# 

of mastery and retention of subject matter. The following issues relate to 
the research problem of uncontrolled variables: (l) How equivalent was the con- 
tent presented in the programmed format and the conventional format? A difference 
in content might have worked to the advantage or disadvantage of either group, 

(2) Because the public schools have a responsibility to parents and students to 
provide the most effective teaching possible for a.11 individuals, necessary 

as mentioned above, to make administrative decisions, which, while helping to 
insure excellence of instruction, may have resulted in the confounding of the 
independent variables. These decisions involved the use of conventionally written 



text materials with the experimental group for a total period of about ten weeks 
over the three-year study^ and the supplementary individual and small group instruc- 
tion which was generally provided to all students in both treatment groups who 
required such help. 

A caveat is entered in the interpretation of the results of this experiment. 

The authors have attempted to apprise the reader of certain operational aspects of 
the study which might have influenced results. Any attempt to generalize from these 
findings should take into consideration the fact that the experiment took place in 
a real teaching situation, which made it difficult to maintain rigid control over 
the application of the. treatments being compared. 

Is there a relationship between success with one or the other instructional 
format and various student personality differences ? The basis for answering this 
research question is not taken to be individual instances of association between 
personality traits or vocational preferences and scores on the various criterion 
measures. Rather, the investigators looked for the emergence of a consistent 
patcern of association. The possibility of such a pattern of association was 
investigated first among the high achieving and low achieving students within 
the group using programmed instruction. Second, the possibility of such a pattern 
of association was investigated among the students within each treatment group. 

No conclusive pattern of association developed in either of these two cases 
between the items measured by the Thurstone Temperament Test or the Kuder Prefer-' 
ence Test and the various criterion measures. 

As reported in the correlation matrices. Tables A15, p. Al; Al6, p. A6; A17, 
p, .AlO; and A18, p. AI 4 , significant correlations did appear rather consistently 
between the baseline measures, including the measures of mental ability and achieve- 
ment in reading and arithmetic, and the standardized tests used to measure mastery 
and retention of subject matter. Thus, on the basis of these results, one would 
conclude that ability and achievemeit levels are more reliable predictors of 
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disposition. 

Are certain mathomatical concepts and skills taught more effectively by the 
use of one instructional format than the other ? Generally, if total mean scores 
on the standardized tests were in favor of one or the other group, the subtest 
mean scores on these tests followed the same pattern. Some exceptions may be 
noted; e. g. , the control groujp obtained a statistically significant higher 
adjusted total mean score on the Baltimore City Advanced Mathematics Posttest, 
as reported in Table 10, p. 29, whereas the experimental group obtained a higher 
mean on the Probability and Statistics subtest. Several other instances of 
particular concepts and skills which seem to have been taught more effectively 
by programmed instruction may be noted in Table 4j p. 15 and Table 9> p.26. Because 
the resu].ts were not conclusive, the authors feel that this question deserves 

t 

further investigation. 

Do students using programmed instruction or traditional instruct ion in high 
schoo l mathematics obtain better grades in first-year colleg e mathematics_ courses? 
The Scholastic Aptitude Test was administered to both treatment groups at various 
times during the final year of the study. On this measure of general ability 
and achievement related to academic success on the college level, the control 
group obtained a significantly higher adjusted mean. This test serves the pur- 
pose of an additional baseline measure, rather than a measure of mastery or 
retention of subject matter. On the basis of the results of the baseline measures 
given initially to the original group of 177 experimental students and 137 control 
students, as well as the results of the Scholastic Aptitude Test given to the 
remaining forty-two experimental students and thirty-six control students, one 
might question, the equivalence of the two groups both during the early stage 
and final stage of the study. Although differences in intelligence as measured 
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by the Otis Quick-Scoring Test of Mental Ability were controlled for by analysis 
of covariance, the authors feel that the results should be interpreted with the 
knowledge that subject bias resulting from the effects of differential achieve- 
ment levels may have worked to the disadvantage of the group receiving programmed 
instruction. 

As reported in Table 13, p. 34 and Table 14, p. 35, it appears that the 
control group took more advanced mathematics courses in the first year of college 
and earned better grades. Whether this is a result of the conventional instruction 
that these students experienced in high school is not clear. A rival hypothesis 
to the one claiming an empirical relationship between mastery of subject matter 
and conventional Instruction would be that the students who elected to remain 
in the more advanced, traditionally taught mathematics courses were more earnest 
mathematics students and had the benefit of greater ability and achievement in 
mathematics. 

Observations and Conclusions of Teachers . In the opinion of the teachers who 
participated in the experiment, students using programmed instruction achieved at 
about the same levels as comparable students using conventional instruction. This 
observation held for the understanding of theory as well as the mastery of mechanics. 

Feedback from students indicated that they generally found long 'stretches of 
straight programmed instruction boring. Related to this finding were two others 
concerning interest and motivation. The teachers did not feel that more interest 
in mathematics was developed by one method than by another. Moreover, while some 
students using programiaed instruction were motivated to move ahead faster than 
required, the majority were content to stay on schedxile. 

The teachers expressed a belief that well-written programmed 
texts not only provided for differences in learning rates, but allowed teachers 
to get to know students and their learning styles much better. This led to the 
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devolopment of more rapport between students and teachers than is possible in a 
class using conventional instruction. Other positive benefits came from the 
increased responsibility for learning that programmed instruction placed on the 
students. Both the .teachers and the students felt that this increased self- 
discipline would help them adjust to the requirements of college. 

Finally, weighing the advantages of programmed texts and conventional texts, 
the teachers agreed that programmed texts would be most valuable when used as 
part of a total course or program of instruction or as a supplement to conventional 
instruction. 
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IMPLICATIONS 

The results of this study lend a degree of support to the hypothesis that 
different teaching methods, namely, programmed instruction and conventional 
instruction, do appear to have statistically significant effects on the learning 
and retention of secondary mathematics, as measured by standardized tests of 
subject matter. Although the treatment group receiving conventional instruction 
appeared to achieve in a fashion superior to that of the group receiving pro- 
grammed instruction, the authors do not believe that the relative effectiveness 
and value of the two teaching methods has been conclusively established by this 
or other similar studies reported in the literature. 

There is first the question of the practical and operational importance of 
modest differences, which may nonetheless prove to be statistically significant. 
There is, in addition, the issue of intervening variables which at once contribute 
to the reality and naturalness of the experimental setting and which pose problems 
for experimental design. 

In conclusion, the authors feel that school systems wishing to try out pro- 
grammed materials on various levels and subjects should not be held back because 

the relative effectiveness of the two teaching modes has not been authoritatively 

# 

established. They should, however, choose programmed materials which promise to 
produce results at least as good, from a practical standpoint, as conventional 
materials. In addition, other considerations such as the cost of programmed 
materials, preparedness and ability of teachers to use teaching materials, and 
student ability levels should influence such decisions. Finally, school systems 
should consider the possibility of using a variety of instructional teaching modes 
and approaches for component skill and content areas within a particular subject. 
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Table A15 Zero-Order Correlation Matrix for the Experimental Group, 
Years I and II, 1965-66 and 1966-67, Variables 1 to 62 



Table Al6 Zero-Order Correlation Matrix for the Control Group, 

Years I and II, 1965-66 and 1966-67, Variables 1 to 62 



Table A17 Zero-Order Correlation Matrix for the Experimental Group, 
Year III, 1967-68, Variables 63 to 98 



Table A18 Zero-Order Correlation Matrix for the Control Group, 
Year III, 1967-68, Variables 63 to 98 



List of Testing Instruments Used 



Sample of Letter Sent to Parents of Experimental Students 



Sample of Follow-Up Questionnaire Sent to Capture First- 
Year College Mathematics Grades 
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APPENDIX 

List of Testing Instruments Used 

a) Otis Quick-Scoring Mental Ability Tests (Gamma Test; Form AM) 
by Arthur S. Otis 

b) Stanford Achievement Test (Advanced Battery Partial: Form KM) 

by Truman L. Kelley 
Richard Madden 
Eric F. Gardner 
Lev/is M, Terman 
Giles M. Ruch 

c) Kelley-Greene Reading Comprehension Test (Form BM) 

by Victor H. Kelley 
Harry A. Greene 

d) Durost-Center - Word Mastery Test (Form AM) 

by Walter N, Durost 
Stella S. Center 

e) Cooperative Plane Geometry Test (Form Z) 

by Educational Testing Services, Princeton, N. J, 

f) Kuder Preference Record - Vocational (Form CM) 
by G. Frederic Kuder 

g) Thurstone Temperament Schedule 
by L. L. Thurstone 

• h) Cooperative Intermediate Algebra Test - Quadratics and Beyond (Form Z) 
by Educational Testing Services, Princeton, N, J, 

i) Cooperative Trigonometry Test (Form Y) 

by Educational Testing Services, Princeton, N, J, 
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List of Testin,q Instruments Used 

j) Baltimore City Advanced Mathematics Test 

by Baltimore Cdty Department of Mathematics 

k) Scholastic Aptitude Test 

by College Entrance Examination Board 
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Sample of Letter Sent to Parents of Experimental Students 



October 7> 1965 

To the parents of : * 

It is a pleasure to inform you that your (son, daughter) has been selecttl 
to participate in a special mathematics program which is to be conducted at 
Northern High School during the next three years. Programmed mathematics 
instructional textbooks and materials are to be used in this program. Programmed 
textbooks enable each pupil to progress at his optimal learning rate in mathe- 
matics. Capable pupils will have an opportunity to obtain instruction in mathe- 
matics courses beyond those which are normally obtainable at the senior high 
school level. The program will also provide an opportunity for individual pupils 
to spend additional time on essential topics and units which may be difficult for 
them. Pupils will receive a great deal of individual help and attention from the 
teacher because the programmed materials give the teacher greater freedom and more 
time to help individuals. 

• All pupils who enter the program will continue their study of geometry with 
programmed geometry textbooks. As soon as a pupil satisfactorily completes the 
programmed geometry course he will commence a study of programmed second year 
algebra. Subsequent courses, which pupils may study after successfully completing 
geometry and second year algebra include: analytic trigonometry, solid geometry, 
probability, statistics, modern algebra, differential calculus, and integral cal- 
culus, All pupils will not be expected nor required to complete all of the afore- 



mentioned courses. 
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Sample of Letter Sent to Parents of Experimental Students 

You will be interested to know that the programmed mathematics textbooks 
which are to be used in this program have been used successfully by high school 
pupils in other cities, other states, and in other Baltimore City schools since 
i960. Many of these pupils have been successful in gaining advanced standing 
in mathematics in college. 

If you want to have your (son, daughter) participate in the special mathe- 
matics program described above please read, check the appropriate box, and sign 
the attached form. Please return the completed and signed form via your son or 
daughter to Mrs. Floretta Fyhr, mathematics department head at Northern High 
School, by October 13, 1965. 

Gladys Mitchell, Principal 
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APPENDIX 

Mathematics Department 
Northern High School 
2201 Pinewood Avenue 
Baltimore , Maryland 21214 



Dear Graduate: 

As a follow-up for the programmed instruction experimental program in mathe- 
matics at Northern High School, in which you participated as a student in either 
a programmed or control class, it is imperative that we know what you are doing 
now. 

If you are in college, please give the name of the college, the exact title 
of any mathematics course you have taken this first semester and the grade earned. 
Your anticipated cooperation in this matter is sincerely appreciated. Thank 
you so much for your help. 

Sincerely, 

(Mrs.) Floretta Fyhr 
(Miss) June Danaher 

pal 




Tear off and return to Northern High School in the envelope provided. 



Place of full-time employment 

OR 

College 

Math course in college : L 

(If you are not taking a mathematics course, v/rite the word "None.") 

Grade earned 

Your name 

Number 1 • • 
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